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Abstract 

Abstract. We consider a strictly stationary functional time series. 

Our target is to study the weak convergence of the discrete Fourier 
transforms under sharp conditions. As a side-result we obtain the 
regular CLT for partial sums under mild assumptions. 
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1 Introduction 

We consider a time series (X^: t G Z) with realizations in some function 
space H. Then every observation Xf is a random curve {Xf{u): u ^U) with 
some continuous domain U. From a technical point of view we require H to 
be a separable Hilbert space and we call the discrete time process {X^ : f G Z) 
a functional time series (FTS). 

Functional time series analysis is a branch of the emerging held of func¬ 
tional data analysis. It is not unusual that functional data are sequentially 
sampled and serially correlated by their very nature. A common situation 
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is that a continuous time process is cut into natural segments, such as days. 
Then there is not just dependence within the individual curves but also 


across curves. Nevertheless, growing attention is only given c 
to this fact. One of the first and most seminal contributors is 


uite recentl y 


Bosal tennnh . 


whose monograph is forming the basic theoretical fo undation for FTS. A 
few re c ent papers devoted to functional time series are | Hyndrrian and Shang 
( 2009 '). Horvath et ah f 2014j) . Horvath et ah ( 2015 ). Aue et al. ( 2015 ). Some 
of the la test publications are rela t ed to fr e quency domain topics for FTS. W e 


refer to iPanaretos and Tavakolil (l2013al) . iPanaretos and Tavakolil (j2013bt). 


Hbrmann et al.l (j2015aj), iHormann et al.l fl2015bl). In their semina l article 


on frequency domain methodology for FTS IPanaretos and Tavakolil fl2013all 
have studied, among others, the limiting behavior of the discrete Fourier 
transform of some FTS (Xt): 


Sn{e) = J2^te 


—itO 


9 e [—vr, tt] 


t=i 


This object is of interest to statisticians since it is closely related to the peri- 
odogram which can, for example, be us ed to detect some underlyin g periodic 
behavior of the time series. (See, e.g., Brockwell and DavisI (1991).) Apply¬ 
ing such a test for periodicity requires knowledge of the distribution of Sn{9). 
But unless (Xt) is a Gaussian process, the exact distribution is infeasible and 
then we need to rely on asymptotics. Moreover we notice that with 6 = 0 this 
framework also contains the regular partial sums process, which is without 
any doubt a crucial building block in many statistical procedures. 

For real valued processes asymptotic normality for Sn{9) has been ob¬ 
tained u nder several d ependence conditions. Here we only cite the early 
paper of Walker ( 19651) who consi dered linear processes and a recent contri¬ 
bution of Peligrad and Wul f 2010h . which covers a variety of special cases, 
including strong mixing sequences. The latter article also contains a more 
de tailed literature survey. For fu nctional data the afore mentioned paper 
of IPanaretos and Tavakolil fj2013al) shows that under regularity assumptions 
-^Sn{9) converges to a (complex) Gaussian random element whose covari¬ 
ance operator is given by 


27rXe:= Y,Che-" 


-ihe 


( 1 ) 


/lez 


where Ch = E ^X^ G Xq] is the lag h covariance operator of the station¬ 
ary functional time series. (It is assumed here and henceforth that Xt are 
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centered by their mean.) The operator which can be shown to be self- 
adjoint and non-negative defini te, is called the spectral density operator. In 
Panaretos and Tavakolil fj2013al) it is assumed that Xlhez (here 

II • II 7 - denotes the Schatten 1 -norm) in order to assure convergence of the series 
defining J^g. This assumption is convenient, because it implies immediately 
that J^g is a nuclear operator, i.e. it has a finite trace. This is an important 
feature when it comes to verifying tightness of {Sn{0)/y/n). Regarding the 
dependence structure, a cumulant type mixing condition for functional data 
is used. The nice feature of such mixing conditions is that no specific time 
series model needs to be imposed. Still, this approach requires to compute 
and bound functional cumulants of all orders, which is generally not an easy 
task and necessitates moments of all orders. 

One of the main results of this article shows the weak convergence of 
Sn{(^) / y/n for purely non-deterministic processes. More precisely, letting Qt = 
a{Xt, Xt-i,.. .) and Q -00 = (^*> 0^-4 impose the following assumption. 


Assumption 1. The process {X^) 
E[Xo\G-oo] =0 a.s. 


is stationary and ergodic and satisfies 


We remark that a conditional expectation for random elements in Hilbert 
spaces as just stated is well defined if i? II Aq 11 < 00 fsee e.g. lBosql (120001. p.29)b 
Besides the obligatory existence of second order moments. Assumption [1] will 
be the only condition needed for the CLT present ed below in Theo r em [H 
This result is an extension of the advances made in Peligrad and WiJ (2010) 
to infinite dimensional data. Since we will not impose any further condition 
assuring summability of the Ch, a tricky part is the construction and defi¬ 
nition of the spectral density operator. Our construction will be an indirect 
one based on a completeness argument in an appropriate Hilbert space. 

In Theorem [2] we will give a result which is slightly less general, but is 
more useful in applications since it will allow for more explicit constructions 
of Xg. In our Theorem [3] we consider the case 6 = 0 and derive the CLT 
for regular partial sums. These main results are presented in Section [H In 
Section [3] we show how the theorems apply in some commonly employed 
dependence frameworks for functional time series models and compare the 
required conditions to existing ones in the literature. Proofs are given in 
Section 01 
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2 Main results 


We start by introducing further notation and stating the setup precisely. The 
process (W) is defined on some probability space and takes values 

in some separable Hilbert space H. The space H is equipped with inner 
product (•, •) and the resulting norm || ■ || = \/t7T- We write X G LF^iVt) 
(short for X G L^{^, A, P)) to indicate that £'||Wp < oo. The space 
is a Banach space and for p = 2 again a Hilbert space with inner product 
E{X, Y). We assume throughout that EXt = 0 (the zero element in H) and 
Xt G Then we denote Ch = CoY{Xh, Xq) = E^X^ ® Wq] . That is, 

Ch{u) = EXh{u, Xq) for u E H. Expectations or other integrals for elements 
with va lues in Banach spa ces are understood in the sense of Bochner integrals, 
see e.g. iMikusihskil fjl978fl . 

The trace of a self-adjoint and non-negative definite operator A ■. H ^ H 
is given by tr(H) = \\A\\f = Wj) for some orthonormal basis {vj) 

of H. For X G it holds that tr(E'[W ® X]) = EUXlp. For a general 

operator A we denote by ||^||r fho Schatten 1-norm of A and by ||^||5 its 
Hilbert-Schmidt norm. 

We use Mnip-i S) to denote a Gaussian element in H with mean /i and 
covariance operator E. Then X ~ if and only if the projection 

{X, u) is normally distributed with mean (/i, u) and variance (E(m), m) for any 
u E H. Although our observations are assumed to be real, the very definition 
of Sn{0) necessitates to adopt a complex setting. So we will henceforth 
assume that the Hilbert space H = Hq + iHq is complex. Let EX = pL = 
/iRe + i/Tim- For u E H define r(M) = E[{X — p){u,X — /i)] and C{u) = 
E^{X — /i)(X — p, m)]. We say that X is complex Gaussian with mean /i, 
covariance T and relation operator C if 


Re(X)\ 
Im(X )) 


Af, 


HqxHo 


/^Re 

/^Im 


■Re(r + C) -Im(r - C) 
Im(r + C) Re(r - C) 


Henceforth, we will only need the circularly-symmetric case, i.e. when /i = 0 
and C = 0. Then we write X ~ CA/'_h-( 0, T). It is straightforward to show 
that X ~ CAfniO, F), if and only if for any u E H 


(Re{{X,u)) 

\\m{{X,u)) 


A/o 


(F(m),m) 0 

0 (F(m),m) 


Finally we recall that a sequence of operators A^ on H is said to converge 
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in the weak operator topology to A if {An{u),v) —)■ {A{u),v) for all u,v ^ H. 
Short we write An —)■ A. 

Theorem 1. Let {Xt \ t G Z) 6e a sequence in which satisfies As- 

sumptionUi Then for almost every 6 G [—vr, tt] there exists a linear operator 
J- 0 , which is self-adjoint and non-negative definite such that 

-^Sn{e)^CAfH{0,7rXe)- 


Moreover we have that 

(I) ^E[Sn{9) (E) Sn{9)] ^27rJ-,; 

(II) ^nSnmin = ^t^{E[Sn{9) ® ^ 27rtr(j-e) < cx); 

(III) Ch = Z^Xee^'^^d9, Vh G Z; 

(IV) the components of ^{Sn{9), Sn{9')) are asymptotically independent if 
9^9'. 

We call J-Q the spectral density operator of [Xt) and remark that it is 
generally not explicitly defined as in ([1]). In fact, the series in ([1]) may not 
be convergent under our mild assumptions. Since 

27rXn;e := \^E[Sn{9) ® S'„(0)] = C;,exp(-ih0), 

” |h|<n ^ 


relation (I) implies solely that the Cesaro averages of (C^ exp(—i/i6*): h G Z) 
converge (in weak operator topology). Existence of Xe will be obtained via 
a completeness argument in an appropriate Hilbert space. 

For practical reasons it is useful to know for which frequencies Theorem [1] 
holds. For example, 6^ = 0 is an important special case, but we cannot say 
if this frequency is part of the exceptional null-set or not. We will see that 
the critical step in the proof of Theorem [T] is to guarantee existence of the 
operator Xg and to establish the related convergence in (I) and (II). By 
the extremely mild assumptions we are imposing, we can only assure this 
for almost every 9. Requiring Assumption [2] below allows us to establish the 
same result for some fixed frequency 9. To formulate this assumption we first 
introduce the projection operator Vk '■= E[ - \Qk] — E[ - |^fc_i], A; G Z. 
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Assumption 2. The process {Xf) is stationary and ergodic and for some 
selected 6 G [—tt, tt] the following properties hold: 

(Al) 'J^ZniO) := Ym^Q'Po{Xt)e~''*'^ is a Cauchy sequence in 

(A2) E\\E[Sn{9)\go]f = o{n). 

This is our second main result. 

Theorem 2. Let (A^: t & 7 j) be a sequence in Ljj{Q) which satisfies As- 
sumption\^ for some given 9 G [— tt, vr]. Then the conclusions of TheoremUl 
hold for this particular frequency 9. 

Assumption [2] looks rather technical, but is relatively easy to verify in a 
variety of models. (See Section [3l) To get some intuition behind these condi¬ 
tions and the general approach we introduce Zm\9) := 
and write 


Sn{9) = + E[SnmGo] 

k=l 
n n 

= EE + E[SnmGo] 

k=l t=k 
n 

= + BlS„(»)|ao|. (2) 

k=l 

The variables Zm\9), k > 1, are orthogonal and by Assumption (Al) they 
have a limit Z^'^\9) in Moreover, it is easy to see that {Z9^\9))k>i is 

a stationary martingale difference sequence. Together with (A2) this guar¬ 
antees that Sn{9) is in some sense close to T„(6*) := The 

partial sum Tn{9) is more handy when it comes to study the CLT and to 
compute the covariance operator. In particular, 

ivar(r„(0)) = Var(Z(°)(0)) =; Ee. (3) 

We conclude this section with a CLT for regular partial sums. It follows 
as a corollary of Theorem O 
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Theorem 3. Suppose that (Xf) G If Assumption\^holds with 6 

then 





0 , 


where T is some non-negative definite, self-adjoint and trace-class operator. 
Furthermore it holds that T = lim^^oo Po(^t)) 


1 


y/n 


^x, + --- + x^)AMH{o,r). 


3 Examples 


The purpose of this section is to show that our results apply to some com¬ 
monly used dependence models for functional data. The typical frame¬ 
work we have in mind comprises processes (Xf) which can be represented 
as Bernoulli shifts, i.e. 

• • •) (4) 


where {et) is a stationary and ergodic sequence of elements in some normed 
vector space S and f : ^ H is measurable. Then (Xt) is again stationary 

and ergodic. We remark that in this case we can use in our theorems the 
hltration {Qk'- fc G Z) with ■ ■ •)• When (et) are i.i.d., then by 

Kolmogorov’s 0-1 law Assumption [1] applies to all such processes. Therefore, 
only requiring the necessary condition Xt G already implies Theo¬ 

rem [TJ But [st) need not necessarily be independent. For example i f ist) are 


Bradley 


strongly mixing then the tail sigma algebra Q-oo is again trivial (see 
(120051. p.lO)) and hence Assumption [1] still holds. 

Representation (0]) is very common to many time series models. In par¬ 
ticular it applies to the two dependence frameworks we are going to dis¬ 
cuss below, namely linear processes (possibly with dependent noise) and 
— m-approximable processes. These two concepts cover most of the func¬ 
tional time series models studied in the literature. Let us beforehand give 
a simple condition which can replace Assumption [2l Here and in the sequel 

•'r(X)={E\\xry'’’,P>l. 


Lemma 1. Assumption IJ\ and condition (A3).- TZM'PoiXt)) < oo to¬ 
gether imply Assumption\^for all 6 G [—tt, vr]. 
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Proof. It is easy to see that (A3) implies (Al) for all 6 G [—7r,7r]. 

Consider the decaying sequence of a-algebras {G-k '■ k > 0). For any inte- 
grable random variable X E H the proces s E[X\Q-k] is a reverse martingale 


with values in H (see e.g. Chatterii f 1964h ) and consequently the increments 


V-k{X) = E[X\G-k] — E[X\G-k-i] are orthogonal elements in Fur¬ 

thermore, by Assumption [T] it then follows that E[X\G_k\ converges a.s. and 
in L‘\j{VL) to E[X\G_^] = 0. Hence, with X = Sn{0) we get 


E\\E[Sr,{e)\G,]f = hm E\\E[S^{e)\Go]- E[E[SM\Go]\G-nW 

n^oo 

i>o i>o 


Therefore we may conclude that 


oo n 

j=0 s,£=l 

OD n 

j=0 S,t=l 

n oo / oo \ 

S EE ''2(P(,(A.+,)) = o(n). 

S=1 j=0 \t=0 J 

□ 

Example 1: Linear processes. 


Consider a linear process Xt = X]fc>o ''^here {et)tez are i.i.d. and 

zero mean in some Hilbert space El' and '^k '■ H' ^ H are bounded linear 
operators. We denote by ||tl/||/: the operator norm. 

Theorem 4. If Xt e Ll (fl) then Theorem [I] holds. If in addition k := 
EA:>oll^fclU < OO then Theoreml^ applies for all 6 G [—tt, tt]. Moreover 

Ee = ;^T(0)HT(0)*, 

ZTT 

where 11/(6') = X]fc>o T(0)* is its adjoint operator and V = 

Var(£o) := ^^o]- 









It is easy to see that £o (n) implies that € L'ljiVt). Consequently, 

our Th eorem 0] improves the corresponding result in iPanaretos and Tavakoli 
f 2013ah . where it is required that Eq E for all /c > 1. 

When 6 = 0 we recover the o r dinary CLT for the partial sums of {Xt) 


as e.g. proven in iMerlevede et al.l fjl997|) . While for real-valued linear pro¬ 


cesses the CLT only requires square summability of coefficients, the latter 
authors prove that in infinite dimensional Hilbert spaces assuming absolute 
summability is essentially sharp. 

Proof. Noting that Vo{Xt) = condition (A3) follows immediately 

from Lemma [U Also, k < oo implies Ch = turn 

yields that YlhEi Therefore Xe has representation ([T]). □ 


Example 2: — m-approximable processes. 


Hbrmann and Kokoszkal ( 2010 ) have used the concept of —m-approximahil- 
ity for analyzing dependent functional data. Then a process {Xf) is said to 
be U’ — m-approximable if Xt has representation (jTj) with i.i.d. innovations 
and 




Aq P < oo. 


m=l 


where = fisn .gn-m+i, g-m, ^-m-i • • •) for some independent copy 

(st) of (et). In Hermann and Kokoszka f 2010[) it is shown that this concept 
applies to many stationary and non-stationary functional time series models, 
including, for example, functional ARCH. The concept is somewhat related to 
near epoc h dependence (NED) o f ten em ployed in the econometrics literature. 
See, e.g., iPotscher and Pruchal 1119971). I f this condition holds with p > 2, 
then by a recent result of Berkes et ahl f 2ni3h a weak invariance pri nciple 
for th e partial sums process holds. This result has been sharpened by l.lirak 
(120131 ) who proved the same invariance principle under p = 2 and also under 
a milder coupling condition. 

Theorem 5. Suppose that (Xt) is Lf — m-approximable. Then Theorem\^ 
applies for all 9 E [—7r,7r]. Moreover, ^ therefore 


Xo = 


27r 


Y^C,e 


-Wh 


hez 
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Proof. We first note that under — m-approxiniability is independent 
of ^ 0 - Hence we get 


< 2E (||i5[X, - X<‘)|6„]f + \\E[X. - Xi‘>\g.,]f) 

< 4£;||X„ - At’ll" = 4,.|(A'„ - A<‘>). 


Now apply Lemma [U 

The absolute summability condition on the Ch has been derived in lHormann et ah 
fenibah . □ 


Example 3: Linear proeesses with dependent errors 


Consider once again a linear process Xt = Ylik>o where now {et)tez 

is a stationary and ergodic zero mean sequence. 


Theorem 6. Suppose that (X^) is a linear proeess satisfying the summability 
eondition X]fc>o ll^^ll-C < Assume moreover that {et)tez satisfies (A3). 
Then the conclusion of Theorem\^ holds. 


For the regular partial sums process, this result compares to lRackauskas and Suquet 


(120101 ) who have studied partial sums of linear processes in Banach spaces. 
They show that the CLT for the innovations transfers to the linear process 
under summability of (||Tfc \\c-.k>0). 


Proof. We apply Lemma [TJ To this end note that 


h'2{'Po{'^ k{£t-k)) 

t>0 t>0 k>0 

iy2{Po{et-k)) < oo. 

k>0 t>0 


□ 
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4 Proofs 


4.1 Preliminary lemmas 

Let G = L\{Vt) and consider the Hilbert space ^G([- 7 r, 7 r],H, A), with E 
and A being the Lebesgne measnre and the Borel a- held on [— 11 , 71 ], respec¬ 
tively. For simplicity we write Lg([—vr, vr]). This space is equipped with inner 
product (V,W) = J"^E{V{0),W(e))de and norm |||1/||| = 

Lemma 2. Define Zn = Zn{9) ■= ■ Then {Zn) is a 

Cauchy sequence in ^G([-7r,7r]); if and only «/ Et>o^ll^-t(^o)IP < 00 . 
Moreover, under Assumption\^ the latter summahility condition holds. 


We remark that this lemma provides a slightly weaker version of Assump¬ 
tion [2l part 1. 

Proof. Using stationarity and the orthogonality of the functions 9 1-4 , 

9 G [—TT, tt], (f G Z) we obtain for m < n 


2 





2 

d9 

H 


t=m+l t=m+l 


By the arguments in the proof of Lemma [T] we have 


y^E\\V.fiXo)f= lirrv E\\X^- E[Xo\g-nW = E\\X,f <00. 

f ^ n^oo 

f>0 


□ 

It follows under Assumption[T]that there exists an element Z G LU[-^M) 
with |||Z„ — Z||| —)■ 0. This in turn has some important implications. 

(i) Since 

|||Z|f = f E\\Z{9)fd9 < 00 , 

J —TV 

we conclude that £'||Z( 0 )|p < 00 for all 9 G Mq = [— tt, 7 r]\A'"o where A(A'"o) = 
0. Hence, for all 9 G Mq the covariance operator Ee ■= E[Z{9) 0 Z{9)] is 
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well defined, self-adjoint and non-negative definite. The denotation Tq is 
intentional. As we will see later it is defining the spectral density operator 
(compare to (JS])). Since tr(j^ 0 ) = E\\Z{9)\\‘^, this operator is trace class. For 
9 & Nq we set = 0. 

(ii) There exists a sequence (n^) such that E\\Zni^{9) — Z{9)\\‘^ —)■ 0 for all 
9 G Ml := [—TT, 7r]\A^i, where A(A'i) = 0. 

(hi) By construction the mapping 9 Z(9) E G is measurable, and the 
mapping Z{9) : G S (the set of Hilbert-Schmidt operators on H), Z{9) i-^ 
E[Z{9)^Z{9)], is continuous. Hence, 9 ^ Eg is measurable as a mapping 
from [—TT, tt] to the space S, which is known to be a separable Hilbert space. 
Consequently the integral in (III) of Theorem [1] is well defined. 

The next lemma will be used in the proof of tightness and implies part 
(II) of Theorem [H 

Lemma 3. Under Assumption\^ we have for all 9 G M 2 = [—vr, 7r]\A^2 with 
A(A" 2 ) = 0 that 

= J_ w (l_hl 

27r \ n 

\h\<n 

Proof. Set Ch := ffi^E\\Z{9)\\'^e^^^d9. Using (i) we infer from the Fejer- 
Lebesgue theorem that 

(1 — ^ j Che~^^^ -E F'||Z( 6 ')|p = tr(j^ 0 ) < 00 for almost all 9. 

\h\<n A ^ / 


tr(Jn;e) 


^E{Xh,Xf)e-'^^^ ^ti{Eg) < 00 . 


We define M 2 as the set of convergence points. We show now that Ch = 
E{Xh,Xo). Using Lemma [2] and continuity of ||| • |||, it can be readily shown 
that 

c,= lim [\\\Zr,{9)\\^U^^d9. 

n^oo I 

J —TT 

Without loss of generality assume h > 0. Using stationarity we deduce 


E\\Zr. 


2^ihe 


d9 = EE E{Vo{Xt),Vo{Xfi) 


t=0 s=0 


271 




n n 

= J2e{Vo{X,),Vo{X,_,)) = J2E{V.t{Xo),V.t{X.h)). 

t=h t=h 
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Since the terms V-t{XQ) and V-s{X_h) are orthogonal in L‘jj{Q) for s ^ t, 
it follows that 

n n \ 

t=h s=h / 

We recall that {E[XQ\Q_t]: t > 0) is a reverse martingale, it follows by As¬ 
sumption [T] that 


E\\Z,, 


^d9 = E 


n Q 

Y.'P-tiXo) = E[Xo\g-h] - E[Xo\g-(n+i)] E[Xo\g.h]. (s) 

t=h 


Similarly, YTs=hE-s{X_h) E[X_h\g-h\ = X_h- And hence, by continu¬ 
ity of the inner product, Ch = E{E[XQ\g_h],X_h) = E{Xh,Xo). □ 

Lemma 4. The operators Eq define the spectral density operators of (XJ 
at frequency 6. This is 

/ TT 

Ee g'^^de, \/h e Z. 

■TT 

Proof. We have seen in (iii) that the mapping 6 Ee is measurable. The 
integrand is valued in the separable Hilbert space S. Since ||Xe|| 5 (i 6 * < 
Jf^trl^Ed'jdO < oo we know that Ee is strongly integrable and hence we can 
dehne (in the sense of a Bochner integral) / = Ee e^^^dd. Let u,v & H. 
Since Bochner integrals are interchangeable with bounded linear operators 
we obtain 

/ TT /‘TT 

{Eeiv),u)P^^de = / E{z{e),u){z{e),v)^p'^^de 

■TT J —TT 

/ TT 

E{Zn{e),u) {Zr,{Q),v)^P^^dB. 

•TT 

The last equality can be deduced from |||Z„ — Z||| 0. Assume now with 

loss of generality that h > 0. Similar arguments as in Lemma [3] lead to 


{I{v),u) = lim E 

n—^oo 


n—h 


t=0 


J2E-t{X^),u) {v,J2E-s{X, 


n—h 


s=0 
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From (jS)) it follows that 

{I{v),u) = E[{E[XH\go],u) (r;,Xo)] = {Ch{v),u). 

Since u and v are arbitrary in H, we can infer that I = Ch- □ 

We show next that the projections {Sn{9),u) / ^/n, u E H, converge weakly 
to {So{9),u), where So{9) ~ CJ\fH{0,7iEo) is the limiting complex Gaussian 
element and where Ee is dehned in (i). The hrst step towards this result is 
given by the following proposition. 

Proposition 1. Under Assumption\^ there exists for all u E H a set N C 
[—TT, vr] of Lebesgue measure 0, such that on M = [—7r,7r]\iV the following 
holds: 


(a) lim^^oo Var((S'„(6'),M))/n = \imn^oo‘^T^{En-,e{u),u) = 27i{Ee{u),u); 

(b) [Re{{Sn{9),u)),lm{{Sn{9),u)))/y/n A J\f2{0,7r{Ee{u),u) x E); 


Proof. We hrst show that there exists for all u E H a set W C [—tt, tt] with 
X{Nu) = 0, such that on Mu = [—tt, 7r]\W (a) and (b) hold. 

Let u E and let Qk{u) be the hl tration of the process ( (Xt,u): t E Z). 
From the results in Peligrad and Wu Peligrad and Wul ( 2010 ) we obtain that 
XaT{{Sn{9),u))/n —)■ 27r/“(6*) for some function f'^{9) which is hnite on M^. 
More precisely, slightly adapting the proofs of Lemmas 4.1. and 4.2. in their 
article we obtain that the L‘^{Q) limit 


Z“(0) 


lim _ 

n^oo y/2'K 


t=0 


lim {Zn{9),u) 

n^oo 


exists on Mu and that /“(6') = Var(Z“(0)). (Directly using their argu¬ 
ments would require to use the projection operator Vf{-) = E[ - \Qo{u)] — 
E[ - |^_i(m)].) We assume without loss of generality that M = Mq fl Mi is a 
subset of Mu, otherwise replace Mu by Mu H M. We now determine f'^{9). 
By result (ii) of Section ITT] it follows that E{{Zn^{9),u) — {Z{9),u)Y —)■ 0 
for every u E H and all 9 E Mi. Hence, by result (i) in the same section, we 
get 

Var((Zu,(9),u}) ^ (Ee {u),u) < oo, 

for all 0 G M and all u E H, which implies on Mu the relation f^{9) = 
{Eg{u),u) < OO. This shows part (a) on Mu- 
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We have E[{Xt,u)\Q_oc^ = {E[Xt\Q-oo])U) and by Assumption [T] this 
is equal to zero. The tower property of conditional expectat ions implies 
E\{Xu u)\Q-oo{u)\ = 0 and hence on Mu (b) directly follows from iPeligrad and Wu 
( 20101) . Let us note that their CLT result is stated for real valued time series, 
but this requirement is not needed. Hence we can apply it for the time series 
((W, u): t >1) which takes values in C when u E H. 

It remains to prove that for all n in iL we can hnd a common exceptional 
set of Lebesgue meagre 0. To this end let H' beji dense and countable 
subset of E[. We set M = Ou'^h'Mu. Then [—tt, 7 r]\M has Lebesgue measure 
0. Furthermore, for all u' G H' and 9 E M (a) and (b) hold. The objective 
is now to extend this result to all u E H. For (a) we observe that 


{En-e{u),u) - {E0{u),u)\ 

< \{En-g{u),u) - {En-,eiu'),u') \ + \ {Ee{u'),u') - {Ee{u),u)\ 
+ \ {En-e{u'),u) - {Ee{u'),u')\ 
tr(Jk;0) +tr(j'0) X (||m|| + ||m'||) X ||m 
+ \{En;eW).u') - {EgW),u')\. 


< 


Since we can assume without loss of generality that M 2 C M, it follows that 
for all 0 G M 


limsup - {Ee{u),u) \ < 4:e{\\u\\ + 1 ) tr(j' 0 ), 

n^oo 

if ||m — u'll < s < 1. Since e can be chosen arbitrarily small result (a) follows. 

The proof of part (b) follows along similar lines of arguments. Just 
compare the characteristic functions of the real and complex part of {Sn{9),u) 
to the corresponding normal ones. □ 


4.2 Tightness 

Lemma 5. Consider sequences : j > 1), n > 0, with the following 
properties: (a) > 0 for all j,n; (b) lim^p^."'^ = p^°\- (c) = p < 

00 ; (d) lim„ = P; (e.) < 00 for all n>l. Then 

lim sup p^”^ = 0. 

m^oo „ ^ ^ 

j>m 
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Proof. Fix an e > 0. We have to show that for m > m{e) we have ^ 

e for all n > 1. 

By (c) we can choose mi = mi{e) snch that < ^/S for all 

m > mi. Fnrtherniore, by (b) we can choose a large enongli rii = ni{e) snch 
that for all n > ni we have | ~ < ^/3- Next, by possibly 

farther enlarging ni we dednce from (c) and (d) that | J2j>iP^j^'^~J2j>iPf'^\ < 
e/3. Conseqnently, for n > rii, we have 

mi 

Epr=Epr’-Epr 

j>mi j>l j=l 

mi mi mi 

s I Epf - Epf I+1 Epf - Epf’i+1 Epf’ - 

i>i i>i t>i i=i i=i i=i 

< £. 

Becanse of (a) this bonnd is still valid for all m > mi. For the ni jnst chosen, 
we can find an m 2 = m 2 {e), snch that ^ ^ n < rii. This 

is becanse of (d) and (e) we know that snp„>i < cxo. And again, 

becanse of (a) we know also that 'YhjymPY^ ^ ^ ^ — ''^2 and n <ni. 

Hence, set m{e) = max{mi,m 2 }. □ 

Lemma 6. Take some ONE {vj) of H. Lemma 0 applies with = 
{TnA^j),Vj), p® = {J'eivj),Vj) for all 9 e M. 

Proof. We can assnme that Vj G H' for all j > 1. Relation (a) is triv¬ 
ial. Relation (b) follows from part (a) of Proposition [T] Relation (c) holds 
becanse J^q is nnclear on M. And similarly relation (e) holds becanse appar¬ 
ently is nnclear for any n. Finally note that (d) can be reformnlated as 
ti{^Fn-e) tr(j^e). By Lemma [3] this holds for almost all 9 G M 2 C M. □ 

Lemma 7. Under Assumptions\^ the sequence {Sn{9)/^/n: n > 1) is tight 
for all 9 G M. 

Proof. Let e > 0. We consider the seqnences 0 < ^ cxo and 0 < A^^^ ^ cxo 

and define 

K = e H : • 

k=l I j>Nk ) 
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Just as in Bosql f 2000[) (p. 52) we can see that it is a compact subset of H. 
We now have that 


p (Snie)/^ eK)>l E\{Sn{e)/V^,v,)\" 

k=l j>Nk 

CO 

= 1 ~ ^ ^ 27r/fc ^ ^ {Pn-,9{'Vj),'Vj), 

k=l j>Nk 


where we used the cr-subadditivity and the Markov inequality. By Lemma [6] 
we know that 

sup -^0 (m -)■ cx)). 

n .. 
j>m 

Therefore, for any e > 0, we can choose increasing sequences {Ik) and (W) 
such that 

2TTlk ^ {PnA^j)^^j) < 

j>Nk 


□ 


4.3 Proofs of Theorems [T] and [2] 

Proof of TheoremUi Parts (II) and (III) of Theorem [T] follow directly from 
Lemmas [3] and m Part (I) can be deduced from the polarization identity for 
self-adjoint operators P 

(r(2^), I/) = ^ [(r(2; + y),x + y) - (r(a: -y),x-y) 

+ i(r(a; + iy),x + iy) - i(r(a; -iy),x- iy )], 


and part (a) of Proposition [H Next, the asymptotic normality of Sn{0)^/n 
for all 6* G M follows from the corresponding convergence of the projections 
(Proposition [H part (b)) and the tightness shown in Lemma [71 Finally, 
the asymptotic independence relation (IV) can be obtained by verifying it 
fo r the projections {Sn{6), u) /\/n and {Sn{0'),u) /^/n. For this we can refer 


to 


Peligrad and Wul fl2010l 


□ 
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Proof of Theorem\^ Let 6 G [—vr, vr] be such that Assumption [2] is satisfied. 
Due to relation ([2]) we have that 


E\\Sn{e)r 

n 


o ^ -I 

— E + - B|lB[S„(«)|e„l 

k=l 

27rE\\Z^^\e)f + 0 ( 1 ), 


where we used both (Al) and (A2). Since tr(J-e) = E\\Z^^^{9)f we conclude 
that (11) holds for the fixed 6. Note that condition (Al) just provides a 
stronger version of Lemma |2J There we only get the limit of (= Zn^) in 
Lq([—TT, vr]), whereas now we get it pointwise by Assumption (Al). In other 
words, we got rid of the exceptional sets Ni and N 2 in Lemmas [2] and |3l The 
proof of Lemma H] is unchanged, hence (III) follows. 

Proposition [1] can be proven even more easily for a given 6 G [—7r,7r]. For 
part (a) we project ([2]) onto u E H and deduce just as above that 

F;|(^„(g),u)p ( 0 ) , ^ 

n 


This also shows (I) by the polarization identity. Part (b) can be shown 
b y the same martingale approximation as in the proof of Theorem 2.1. 
of lPeligrad and Wd fcOlOh . Alternatively, one may directly apply Theorem 2 


m 


Wul (1200411 . 


Finally the tightness of Sn{0)/^/n can be shown using the same proof 
as in Lemma [7] since it is now clear that relations (a)-(e) of Lemma |5] are 
satisfied for the particular 9. □ 


Acknowledgement 

This research was supported by the Communaute frangaise de Belgique— 
Actions de Recherche Concertees (2010-2015) and from the Interuniversity 
Attraction Poles Programme (lAP-network P7/06), Belgian Science Policy 
Office. Clement Cerovecki acknowledges support from the F.R.S.-FNRS Fond 
de la Recherche Scientifique, Rue d’Egmont 5, B-1000 Bruxelles. 


18 













References 


Aue, a., Dubart Norinho, D., and Hormann, S. (2015). On the pre¬ 
diction of stationary functional time series. Journal of the American Sta¬ 
tistical Association, 110, 509, 378-392. 

Berkes, I., Horvath, L. and Rice, G. (2013). Weak invariance principles 
for sums of dependent random functions. Stochastic Processes and their 
Applications, 123, 385-403. 

Bosq, D. (2000). Linear Processes in Function Spaces. Springer, New York. 

Brockwell, P.J. and Davis, R.A. (1991). Time Series: Theory and 
Methods. Springer, New York. 

Bradley, R.C. (2005). Basic Properties of Strong Mixing Conditions. A 
Survey and Some Open Questions. Probability Surveys Vol. 2, 107-144. 

Chatterji, S.D. (1964). A note on the convergence of Banach-space valued 
martingales. Mathematische Annalen, Volume 153, Issue 2, pp 142-149. 

Hormann, S., Kidzinski, L. and Hallin, M. (2015). Dynamic Functional 
Principal Component. Journal of the Royal Statistical Society: Series B, 
77, 319-348. 

Hormann, S., Kidzinski, L. and Kokoszka, P. Estimation in functional 
lagged regression. Journal of Time Series Analysis. (Forthcoming. DOI: 
10.1111/jtsa.l2114.) 

Hormann, S., Kokoszka, P. (2010). Weakly dependent functional data. 
The Annals of Statistics, 38, 1845-1884. 

Horvath, L., Kokoszka, P., and Rice, G. (2014). Testing stationarity 
of functional time series. Journal of Econometrics, 179, 66-82. 

Horvath, L., Rice, G., and Whipple, S. (2014). Adaptive bandwidth 
selection in the estimation of the long run covariance of functional time 
series. Computational Statistics and Data Analysis. Forthcoming. 

Hyndman, R.J. and Shang, H.L. (2009). Forecasting functional time se¬ 
ries. Journal of the Korean Statistical Society, 38, No. 3, 199-211. 


19 


JlRAK, M. (2013). On weak invariance principles for sums of dependent 
random functionals. Statistics and Probability Letters, 83, 2291-2296. 

Merlevede, F., Peligrad, M. and Utev, S. (1997). Sharp Conditions 
for the CLT of Linear Processes in a Hilbert Space. Journal of Theoretical 
Probability, 10, No. 3, 681-693. 

Mikusinski, J. (1978). The Bochner Integral. Birkhauser, Basel. 

Panaretos, V.M. and Tavakoli, S. (2013). Fourier analysis of sta- 
tiononary time series in function spaces. The Annals of Statistics, 41, 
No. 2, 568-603. 

Panaretos, V.M. and Tavakoli, S. (2013). Cramer-Karhunen-Loeve 
representation and harmonic principal component analysis of functional 
time series. Stochastic Processes and their Applications, 123, 2779-2807. 

Peligrad, M. and Wu, W.B. (2010). Central limit theorem for Fourier 
transforms of stationary processes. The Annals of Probability, 38, No. 5, 
2009-2022. 

POTSCHER, B.M. AND Prugha, I.R. (1997). Dynamic Nonlinear Econo¬ 
metric Models. Springer. 

Rackauskas, a. and Suquet, Ch. (2010). Cn limit theorems for Banach- 
space-valued linear processes. Lithuanian Mathematical Journal, 50, No. 1, 
71-87. 

Walker, A.M. (1965). Some asymptotic results for the periodogram of a 
stationary time series. Journal of the Australian Mathematical Society, 5, 
No. 1, 107-128. 

Wu, W.B. (2004). Fourier transforms of stationary processes. Proceeding of 
the American society, Vol 133, Number 1, Pages 285-293. 


20 


